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Abstract. This is the second installment to the project initiated in [Ma3]. In 
the first Part, I argued that both philosophy and technique of the perturbative 
renormalization in quantum field theory could be meaningfully transplanted to the 
theory of computation, and sketched several contexts supporting this view. 

In this second part, I address some of the issues raised in [Ma3] and provide their 
development in three contexts: a categorification of the algorithmic computations; 
time cut-off and Anytime Algorithms; and finally, a Hopf algebra renormalization 
of the Halting Problem. 
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0. Introduction 

0.1. Regularization and Anytime Algorithms. It is well known that 
classical theory of computability includes as its organic part phenomena of non- 
computability. Namely, an attempt to compute the value of a partially recursive 
function at a point where it is not defined, might stall the computation forever, but 
we will never know whether this is so or simply we did not wait long enough ( "the 
Halting Problem is undecidable" ) . 

Applied theory of computation deals with algorithms processing finite amount 
of data into finite outputs. Nevertheless, even in such theoretically safe situations 
time/memory requirements may make the implementation of a sound algorithm 
unfeasible. 

The celebrated theory of polynomial time computations and discovery of the 
P/iVP-problem served as a neutral zone meeting point between theoretical possi- 
bility and practical feasibility, and revealed beautiful new mathematical structures. 
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However, applied computer scientists consider other possible ways of turning 
unfeasible computations into feasible ones, known under the code word "Anytime 
Algorithms". Basically, an "Anytime Algorithm" allows the computation to stop 
at a feasible time, and supplies the result of such a mutilated procedure with a 
measure of its quality. See [GrZi] and a nice short introduction [Gr] . 

In the Sec. 2 of this article, the second installment to the project initiated in 
[Ma3], it is suggested that theoretically "Anytime Algorithms" can be treated as 
one of the versions of regularization schemes in Quantum Field Theory: time cut- 
off (for more detailed description of the whole project, see Introduction to [Ma3]). 
More precisely, I analyze from this viewpoint results of the stimulating paper by 
Ch. Calude, M. Stay "Most programs stop quickly or never halt" ([CalStl]). 

One of the themes, that the analogies with renormalization and experience with 
Anytime Algorithms bring to the foreground in the computation theory, is the 
stress on the structure of programs determined by the operation "composition of 
programs" and by the explicit parallelism, that played a key role in our treatment 
of perturbative renormalization as a model for regularizing computations in [Ma3]. 

Notice that many standard descriptions of programming methods are not stable 
with respect to the composition and have no natural means for expressing paral- 
lelism. 

For example, composition T2 o T\ of two Turing machines, informally defined as 
computation in which the output of T\ becomes the oracular input ( "program" ) for 
Tii is not directly described as a new Turing machine T3. 

Language-like constructions such as lambda-calculus, being inherently linear/se- 
quential, are not well-suited for expressing options of parallelism. 

"Flowcharts" imagery for which I made some propaganda in [Ma3] serves these 
goals much better. In the Section 1 of this article, I show that the same ideas admit 
a succinct categorical expression, and suggest that flowcharts constructions from 
[Ma3] can be interpreted as a constructive existence theorem, to produce what I call 
"an enriched programming method with unrestricted parallelism" (cf. Definition 
1.8.1). This seems to be very much in the spirit of [BaSt]. 

Finally, Section 3, using some ideas from quantum computation, provides a Hopf 
renormalization scheme for the Halting Problem. 

0.2. Computability as a mathematical structure and its interaction 
with other mathematical structures. Most of the constructions considered in 
this paper refer to (un)feasible algorithms with infinite domains/ranges. Devising 
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their natural quantitative characteristics and regularization schemes for them, one 
should keep in mind that they can be roughly subdivided into two large blocks. 

BLOCK A. This block consists of the inherent problems referring to an infinite 
constructive world X, which depend only on the class of "admissible" recursively 
equivalent numberings of X , and which are the same for all infinite X. From the 
computational viewpoint, any such X can be identified with N (natural numbers) 
or Z + (nonzero natural numbers). 

A typical example of such an X is some set of finite Bourbaki structures, such 
words in a finite alphabet, or finite groups, or graphs, or their descriptions, etc. 
In this context, one uses the Bourbaki description primarily in order to define 
the class of admissible bijections (numberings) Z+ — > X in question: they must be 
informally computable together with their inversions. One aspect of Church's thesis 
consists in the statement that recursive functions will provide an adequate notion 
of algorithmic processing of elements of X whenever we can imagine an informal 
algorithm producing the numbering. 

Once it is decided that the role of the respective Bourbaki structure is over 
as soon as the class of numberings is determined, one can make explicit various 
secondary structures on X that can be defined exclusively in terms of admissible 
numberings. 

One such structure is the algebra of enumerable subsets of X: definition domains 
D(f) of partial recursive functions. This family is stable wrt finite intersections 
and enumerable unions. If one consider these sets modulo finite ones, one can prove 
interesting results about simple sets, maximal sets etc. For example, maximal D(f) 
display a striking similarity to the holomorphy domains V in the theory of complex 
analytic functions of > 2 variables: in both cases, there are functions defined on 
D(f), resp. V, that cannot be extended to a larger domain. 

The proviso "modulo finite subsets" can be very naturally formalized by chang- 
ing the Constructive Universe C described in Sec. 1: simply consider the largest 
quotient of C making invertible those morphisms (computable maps) X — > Y that 
become computably invertible after the restriction to some subsets of X and Y with 
finite complements. 

Another such structure is the class of Kolmogorov's orderings: total orders on 
X defined by increasing Kolmogorov complexity with respect to various optimal 
enumerations. 

Such orderings are not computable, but with respect to them all recursive func- 
tions, including admissible numberings, become functions of linearly bounded growth 
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I discuss this feature from the renormalization viewpoint in Sec. 3. 

BLOCK B. This group consists of problems about interaction of computability 
with other Bourbaki sructures on X. An elementary example is the embedding 
X = Q C R used in the theory of computable rational approximations to real 
numbers. 

In this block, the Diophantine representability of enumerable subsets of N was 
the greatest discovery (Davis, Robinson, Putnam, Matiyasevich) . 

A very interesting and unexpected example of such interaction was elaborated in 
the work of A. Nabutovsky and S. Weinberger, (cf. [NaWe]), who have shown that 
the computational complexity can be used to display a highly irregular landscape 
of minima of natural differential-geometric functionals on the space of Riemannian 
metrics modulo diffeomorphisms. 

Since path integration over such a space is one of the key tools of quantum 
gravity, this can become an important next meeting space between renormalization 
and computation. 

Acknowledgements. I am very grateful to Cristian Calude, Leonid Levin, Mike 
Stay, Noson Yanofsky, who sent their remarks and suggestions incorporated in this 
draft of the article. 

1. Enriched programming methods with typing and parallelism: 

a categorical approach 

1.1. Preliminary remarks. We denote by N the set of natural numbers, and 
by Z + that of positive natural numbers. Usually N is taken as the basic set on 
which recursive functions are defined; in [Mai] I used Z + having found it more 
convenient in a Diophantine context. 

As a Bourbaki structure, both Z + and N are here (isomorphic) totally ordered 
sets, with a minimal element 1 (resp. 0) and successor function suc(x): "the smallest 
y such that y > x" , or suc(x) = x + 1 in the standard notation. In a sense, this 
is the minimal structure needed to define the set of partial recursive functions that 
are partial maps Z + — > Z + or, more generally (Z + ) a — > (Z + ) c . The remaining 
components of the definition (see e. g. [Mai], V. 2. 1-2.4) are just the standard 
category-theoretic constructions in a fixed monoidal category of sets (Par Sets, x) 
with partial maps as morphisms and cartesian product: cf. [Ma3], 3.7. 

However this total order structure is not invariant with respect to the structure 
that we will define below, in the sense that it is not preserved under the automor- 
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phisms of this structure. For this reason, we avoid one of the standard categorifica- 
tions of computation theory in which N is replaced by a "natural numbers object" 
M (of an abstract category), endowed with a morphism suc^ : M — > N: this cate- 
gorification unduly stresses the role of this total order and iteration suc^ °- • -osucyv - 
related to it. 

Instead, we adopt the version advocated in [Ma2], that of a subcategory C of 
Par Sets called Constructive Universe. In 1.2-1.8 below I collect the relevant formal 
definitions. Informal comments are relegated to 1.10. 

1.2. Objects. Objects of C will be called constructive worlds. 

1.2.1. Definition. A constructive world X is either a finite set, or an infi- 
nite set endowed with a nonempty set Num(X) of bisections v : Z + — > X, called 
admissible numberings, satisfying the following conditions: 

(i) If vi, i>2 G Num(X), then o v\ is a total recursive bisection. 

(ii) If v e Num(X) and f : Z + — > Z + is a total recursive bisection, then 
iso f e Num(X). 

Elements of the constructive world X are called constructive objects of the type 

X. 

1.3. Morphisms. Let X, Y be two constructive worlds. Morphisms X — > Y are 
induced by partial recursive maps on their structure numberings. More precisely: 

1.3.1. Definition. A morphism X — > Y is partial map f : D(f) — > Y , where 
D(f) C X a subset (possibly empty) satisfying the following conditions: 

(i) If X be infinite, Y is finite, then for one (equivalently, any) admissible num- 
bering v : Z + — > X and any y <EY, the set u~ 1 (f~ 1 (y)) is recursive enumerable. 

(ii) If X and Y are infinite, then for one pair (equivalently, any pair) admissible 
numberings vx '■ Z + — > X, vy : Z + — > Y , the partial map Vy X o / ' o i> x : Z + — > Z + 
is a partial recursive function. 

(Hi) If X is finite, Y is infinite, any partial map is a morphism. 

With the standard composition of partial maps, constructive worlds form a cat- 
egory C, which we will call Constructive Universe. The set of morphisms X — > Y 
will be denoted C(X, Y). Its subcategory consisting of infinite constructive worlds 
is equivalent to a very simple category consisting of one object, say Z + , and partial 
recursive maps as morphisms. In [He] , such categories are called isotypical ones. 

However, it is important to consider C as (bi)monoidal category, with two sym- 
metric monoidal structures x (direct product) and JJ (coproduct, or disjoint union, 
see [He]), connected by the standard coherence diagrams. 
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These monoidal structures are induced by those in a small category of (unstruc- 
tured) sets in which our constructive worlds lie, so that it suffices to specify some 
privileged numberings of disjoint sums and direct products. Moreover, it suffices to 
consider numberings that are bijective maps Z+ — > YiiLi Z + and Z + — > (Z + ) m . 

For \XiL\ Z + , we simply assign to m(k — the number k in the i-th summand. 

The cartesian product is more interesting, because there are several numberings 
that become privileged in the context of Kolmogorov complexity. TO BE CON- 
TINUED ... 

We will generally assume that C is closed with respect to the monoidal structures 
x and \J. 

1.4. Constructive descriptions of morphisms. Fix two constructive worlds 
X, Y. Since the set of recursive maps C(X, Y) is not a constructive world, we may 
try to replace it by descriptions. 

1.4.1. Definition. A constructive world of descriptions is a pair (P(X,Y), F), 
where P(X,Y) is an object of C, and F : P(X,Y) x X — > Y is a morphism in C, 
satisfying the following condition. 

Let p G P(X, Y). Denote by f p the partial map x i— > F(p, x) G Y,x G X . Then 
each f p is a morphism X — > Y in C. 

In other words, descriptions produce a set theoretic map P(X, Y) — > C(X, Y) 
constructively depending on (p,x). 

1.4.2. Translations. Let (P(X,Y), F) and (Q(X,Y),G) be two constructive 
worlds of descriptions. A translation (or compilation) method 

trans p, Q : P(X,Y) -> Q(X,Y) 

is an everywhere defined morphism in C such that for all p G P(X, Y), trans(p) G 
Q(X, Y) defines the same morphism f p : X — > Y. In other words, 

G o (trans p } q x idx) = F. 

1.4.3. Universal descriptions. The world (U(X,Y),W) is the world of uni- 
versal descriptions, if for any other world of descriptions (P(X, Y),F), there exists 
a translation morphism 



trans P)U : P(X, Y) -> U(X, Y) 
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In particular, it can compute any (semi)computable function, in the sense that 
the family of maps f u : X — > Y, u G Y") contain all morphisms in C. 

1.4.4. Complements. Among various constructive worlds of descriptions 
P(X, Y) there exist ones with better properties than the general definition allows 
to guess. The terminology for them is rather unstable. We will say sometimes (see 
2.6 below) that P{X, Y) is the base of a family f p : X — > Y, p E P{X, Y) of partial 
functions. 

We will review below some relevant definitions and existence theorems. We 
consider separately four cases. 

(i) If X, Y are infinite, we may assume without losing generality that X = Y = 
Z+. 

H. Rogers in [Ro] calls such a world of descriptions U semi-effective, if it com- 
putes all morphisms (partial recursive functions), and he calls U fully effective, if 
it is universal in the sense of 1.4.5. 

An easy construction in [Ro] (example following Definition 3) shows that there 
are semi-effective descriptions that are not fully effective. A universal description 
world U(X,Y) = Z + (or rather N) is also called a Godel numbering in [Ro]. 

The main Theorem of [Ro] in our language implies that for any two universal 
description worlds (for infinite X, Y), there exist two mutually inverse translation 
isomorphisms between them: total recursive bisections, compatible with functions 
that these descriptions compute. 

C. P. Schnorr in [Sch] considerably strengthens this result. Namely, he calls 
a universal description world (U = Z + , W) an optimal Godel numbering, if for 
any other world of descriptions (P = 7i + ,F), there exists a translation morphism 
t : P — * U which is a linearly bounded function Z + — > Z + . We will call such a 
description world simply optimal one. 

Schnorr then proves that optimal descriptions exist, and for any two optimal 
description worlds (with infinite X , Y), there exist two mutually inverse linearly 
bounded translation isomorphisms between them. 

Similar results hold in the case when only one of the worlds X, Y is infinite. 
The general situation can be reduced to the case when the relevant finite world is 
one-element set; for simplicity, we will consider only this case. 

(ii) The case X = {*} is truly exceptional in the following sense: C({*}, Y) , that 
is "Y-valued recursive functions of zero variables", can be canonically identified 
with the set Y and thus it is a constructive world. Nevertheless, the notions and 
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main results of Rogers and Schnorr are applicable to this well and lead to 

a strengthening of the notion of Kolmogorov optimal enumeration of constructive 
objects of a given type. 

(iii) In the case Y = {*}, C(X, {*}) can be naturally identified with the set of 
all enumerable subsets of X, domains of partial recursive functions with one value. 
Godel and optimal numberings of enumerable subsets also can be easily defined, 
and again the Rogers and Schnorr theorems are valid for them. 

(iv) Finally, when both X, Y are finite, the useful structurizations of descriptions 
are those of Boolean polynomials, circuits, etc. Many complexity problems are 
centered around polynomial time computations. Cf. [Ma2] for an introduction, 
that is close in style to this paper. 

1.5. Enrichments of C over itself and programming methods. There 
is a well-known general notion of a category C enriched over a monoidal category 
(M, ®, I) where I is an identity object. 

Below, we will consider enrichments of C over (C, x, I) where I is a fixed one- 
element constructive world. Products of empty families, such as N a for a = 0, are 
interpreted as I. 

According to the general pattern, such an enrichment must consist of the follow- 
ing data. 

a) For each pair of constructive worlds X, Y, an "object of morphisms" P(X, Y) e 
ObC. 

b) For each triple of constructive worlds X, Y, Z, a "composition morphism" in 

C: 

o : P(Y, Z) x P(X, Y) -> P(X, Z) (1.1) 

c) For each object X of C, an identity morphism 

id x : I^P(X,X). (1.2) 

The standard axioms for morphisms in a category translate into requirements of 
commutativity of three classes of diagrams in C expressing properties of associativity 
of enriched composition, and left and right identities. 

1.5.1. Definition. An enrichment of C over (C,x,I) as above is called an 
enriched programming method and denoted Cp, if the following additional data are 
given and axioms satisfied: 
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For each pair of constructive worlds X, Y, a morphism in C is given 

F x ,y : P(X,Y) xX^Y 

such that P(X, Y) becomes a constructive world of descriptions in the sense of 
Definition 1.4-1- Thus, we have a family of set-theoretic maps 

$ X , Y : P(X,Y) - C(X,Y) : p » f p . (1.3) 

We will say that p is a description, or a program, computing f p . 
Moreover, the following axioms must be satisfied: 

(i) Morphisms (1.1) and (1.2) must be everywhere defined (total recursive) maps. 
(For (1.2), this means simply that they are non-empty maps). 

(ii) Compositions (1.1) must be compatible with the compositions of morphisms 
in C: 

fpoq fp ° fq- 

(Hi) Element idx(-0 e P(X, X) must be a description of the "copying" program: 
mapping x to x. 

(The latter should not be mixed with the "cloning" program computing the dia- 
gonal map X^XxX,x^(x,x).) 

Informally speaking, we have a functor 

$p:Cp^C (1.4) 

identical on objects and mapping a program to the function that this program 
computes. 

The most important feature of this formalism consists in an explicit and sys- 
tematic inclusion of composition of programs into our formalism: this is a key 
requirement for all Hopf algebra renormalization schemes. 

Finally, a remark on terminology: we use the word program as a synonym of 
"description of a method to compute a given function". Input of such a program 
is a specific value of the argument of this function, output is the value of the 
function. This praxis should not be confused with the one used in the theory of 
Turing machines, where programs are often understood as our inputs: the initial 
binary string on the tape. 
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1.6. A (uni)versal enrichment. An enrichment Cjj as above is called (uni)versal 
one, if programs from U compute all partial recursive maps, and moreover, if for 
each Cp, there is a functor between enriched categories 

* : Cp^Cu (1.5) 

identical on objects, with total recursive maps 

* XtY) : P(X,Y)^U(X,Y) (1.6) 

such that ^x,y (p) for each p computes the same function as p. In other words, we 
have 

o \I> = $ P . 

Intuitively, we want the following properties of U as a programming method, that 
are somewhat stronger than those in 1.4. 

a) It can compute any (semi) computable function. 

b) For each other programming method P, there must exist a computable (on 
the world of P-programs) translation of P-programs into tZ-programs, computing 
the same functions. 

c) The translation must be compatible with composition of programs and copy- 
ing/identity programs ( functor ality of \&). 

1.7. Coproducts and typing. Coproducts (disjoint sums) admit the most 
straightforward interpretation in the contexts, where computer scientists speak 
about typing. In the simplest situation, a program p e P(X ]J Y, Z) accepts inputs 
of either type X or Y, and produces outputs of type Z. 

Iterated application of similar interpretations, as far as I can judge, can be used 
in all contexts where the notion of typing is essential. 

1.8. Products and parallelism. Let X^Y^i = l,...,n be constructive 
worlds. Then the map 

7T : C(X u Y 1 )xC(X 2 ,Y 2 )x---xC(X n ,Y n )^C(X 1 xX 2 x---xX n ,Y 1 xY 2 x---xY n ), 

7T(/l, • • • , fn)(xi, . . . ,X n ) := (/l(xi), . . . , fn(Xn)) (1.7) 

defines families of computations with independent inputs/outputs that can be im- 
plemented parallely. This can be generalized to programming methods as follows. 
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1.8.1. Definition. Let P be an enriched programming method. We will say 
that P admits unrestricted parallelism, if the following additional structure is given. 

Let {Xi}, {Yi}, % = 1, . . . , n, be any finite family a of constructive worlds. We 
must be given maps 



that are lifts of (1.7). These maps must be equivariant with respect to the natural 
action of the symmetric group S n permuting subscripts at both sides. 

1.9. Basic example: flowcharts. Flowcharts defined in [Ma3] form a con- 
venient context for constructing enriched progamming methods with unrestricted 
parallelism. One example of of such a method is the world P, computing primitive 
recursive functions, described im [Ma3], Definition 2.11. This definition uses the 
ideas of N. Yanofsky paper [Ya]. 

Additional work remains to be done in order to produce a manageable construc- 
tion of an universal enrichment with unrestricted parallelism. 

1.10. Comments: constructive worlds and admissible numberings. 

Technically speaking, conditions (i) and (ii) of Definition 1.2.1 together mean that 
Num(X) forms a principal homogeneous space over the group of total recursive 
permutations of Z + which we may denote Sz+,rec > as an infinite analog of nite 
symmetric groups. Hence the whole Num(X) can be reconstructed from any one 
numbering in this set. Usually there are some simplest, or privileged numberings, 
with which one mostly works, such as the numbering of binary words w E {0, 1} N 
used in [CalStl]: bin -1 : w i— > lw, where the line over a binary word means that it 
should be treated as a natural number given by its binary digits. 

The idea of privileged numberings is essential especially when one deals with 
polynomial time, or more general "feasible" computations. In order to accommo- 
date this idea, we can strengthen Definition 1.2.1 in the following way. Consider 
the smaller "symmetric group" S z + po i of total recursive permutations that are 
polynomial time computable together with their inverses. Define the structure of 
polynomial time constructive world X by a set Numpol(X) forming a principal 
homogeneous space over the group Sz+, po i ■ 

An (often implicit) part of contemporary philosophy around Turing's Thesis 
consists in postulating that whenever we can informally speak about algorithms and 
(semi) computable maps between two constructive worlds, we always can produce in 



n 
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n 




(1.8) 
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the context of this discussion admissible numberings that are informally algorithmic 
and transform informal (semi)computable maps into (partial) recursive functions. 

In any case, starting with such a class of numberings of X, we want to stress 
that we study notions that are either invariant, or behave in a controlled way under 
the action of the group Sx, rec - 

We add a few more remarks. 

Sometimes, a constructive world X itself is an unstructured set, in the sense 
that the only relevant structure on it is given by its set of admissible numberings. 
The typical example is a world A that in further constructions may serve as an 
alphabet. In this case, a numbering dening the whole Num(A) usually is introduced 
ad hoc. But in most applications, X itself consists of certain sets (often finite and/or 
considered only up to isomorphism, or even organized into a category) endowed with 
a certain fixed Bourbaki structure, such as: 

(a) Finite words in an alphabet A. 

(b) Finite graphs up to an isomorphism. 

(c) Finite groups. 

In such cases, the privileged numberings ("encodings") generating the whole 
Num(X) are supposed to interact with this structure in such a way that the num- 
ber of a constructive object can be "algorithmically calculated" when we know 
this object as an instance of this structure, and vice versa, this instance must be 
algorithmically reconstructible from the number. It is only very rarely that such 
encodings can translate well the basic relations, composition laws etc., involved in 
the definition of the structure. This is one reason to formulate models of compu- 
tation directly in terms of this structure: one can recall Church's lambda-calculus, 
Kolmogorov-Uspenski's graphs and Gacs-Levin causal nets (cf. [GaLe]). 

On the other hand, such a simple task as the choice of a privileged numbering 
of Z + x Z + (upon which one of the monoidal structures on C is based) can lead 
to quite interesting constructions when this choice is related, for example, with 
complexity estimates: see our discussion in 2.7-2.10 below using L. Levin's norms 
for definitions of such numberings. 

Notice that instances of the constructive worlds of causal nets studied in [GaLe] 
are themselves categories, and the study of interaction of computability with sym- 
metries of the respective constructive objects reveals interesting new phenomena. 

We want to argue that our categorical framework suggests other possibilities to 
avoid too close attention to the elementary steps of computation. In particular, the 
"categorical Church Thesis" admits a wonderfully succinct expression: 
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The category C is defined uniquely up to equivalence. 

An important complication and variation of the theme of admissible numberings 
arises, when a structure S that we want to treat "constructively" is thus imposed 
on eventually innite sets. In such cases the relevant constructive objects are often 
not the structures themselves, but their finite descriptions: a group might be given 
by generators and relations, an affine scheme over Z by its equations etc. 

The usual complication with descriptions is that many descriptions can produce 
one and the same (or canonically isomorphic) Bourbaki structure, and the rele- 
vant equivalence relation on the set of descriptions can be undecidable, or even 
not recursively enumerable. This is precisely the case of the structure constituted 
by recursive functions themselves, which is our main motivation for introducing 
enrichments as in Definitions 1.5.1 and 1.8.1. 

2. Cut— off regularization and Anytime Algorithms 

2.1. Cut— off regularization. In Quantum Field Theory, cut-off regularization 
schemes have the following typical structure. The relevant Feynman integrals, say, 
in momentum space, may diverge when momentum becomes large (resp. small). 
In this case, the formal integral in question / is replaced by the finite integral Ip 
taken over momenta p < P := p cu toff (resp. p > P := Pcutoff)- The behavior of 
Ip as P — > oo (resp. P — > 0) is then studied, and physical information is extracted 
from the behavior of the polar part, or regular part, of Ip. 

In computer science based upon Turing machines and/or recursive functions, the 
natural "divergence" occurs in space-time: a computation uses discrete memory 
(space) and runtime. A typical example of such a divergence is the infinite runtime 
of a Turing machine computing a partial recursive function / at an input (program) 
x which is outside the definition domain of /. 

Application-oriented computer scientists, of course, recognize the practical ne- 
cessity of time cut-offs, accompanied by sober estimates of quality of outputs. 
Systematic work on this problem resulted in the notion of " Anytime Algorithms" , 
cf. [GrZi]. The usefulness of composition and exploiting parallelism was stressed 
in [RuZi]. 

In a stimulating paper [CalStl], Ch. Calude and M. Stay addressed the problem 
of cut-off of runtime theoretically, and designed meaningful quantitative character- 
istics of such a cut-off. 

More precisely, let / be a partial recursive function ( "a morphism of constructive 
worlds X — > Y") as above, and F its description, a program calculating it. Com- 
putation time (or runtime) is another partial recursive function, with the same 
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domain D(t(F)) = D(f) C X and target Z + , whose precise definition depends on 
the details of the implied choice of our programming method. 

For a Turing machine F, t(F)(x) is the number of steps required to halt and print 
f(x) on the tape, if x e D(f). One can similarly define another partial recursive 
function, "memory volume" m(F) : X — > Z+ such that for x G D(f), m(F)(x) is 
the minimal length of tape required to compute f(x). Here W is the constructive 
world of binary words {0, 1} Z+ . Yet another partial recursive function, s(F), is 
the sum total of lengths of filled parts of the tape over all steps of computation. 
Notice that the settling function of Soare ([So], Definition 8.2), which is essentially 
max{t(F)(y) | y < x,y E D(f)}, generally is not partial recursive, but some of the 
inequalities stated below, such as (2.3), are valid for it as well. 

One can define natural analogs of functions t(F), m(F), and s(F) for rather 
general normal programming methods F, discussed in [Ma2] and Chapter IX of the 
new edition of [Mai]. 

Returning to [CalStl], we will first of all show that some of the basic results of 
that paper related to cut-offs, admit a straightforward reformulation in such a way 
that they become applicable and true for any partial recursive function, including, 
of course, t(F), m(F), and s(F). 

This naturally raises a question, what is so specific about t(F), m(F), and s(F). 
We will treat this question in 2.6 below in the context of categorification developed 
in Sec. 1, and will show that this provides some meaningful insights about these 
measures of processes of computation. 

2.2. Complexity. I will first recall the definition and properties of the Kol- 
mogorov ("exponential", or "program") complexity C u : Z + — > Z + , cf. [Mai], 
VI. 9. In [CalStl] it is called the natural complexity and denoted V[/ or simply V. 

This complexity measure is defined with respect to a partial recursive function 
u : Z + — > Z + which is surjective: 

C u (x) : = min {y \ u{y) = x). 

This function u is an arbitrary element of the set of Kolmogorov, or Godel, optimal 
functions, representatives of which can be effectively constructed: cf. [Ro], [Sch] 
and [Mai]. Optimality implies that for any other partial recursive v : Z + — > Z + , 
there exists a constant c U}V > such that for all x, C u (x) < c UjV C v (x). (The right 
hand side is interpreted as oo, if x is not in the range of v). 



15 



It follows that another choice of optimal function replaces C u by a function 
C u i = 2°^C U . We will say that two such functions belong to the same bounded 
equivalence class. 

Moreover, as we have discussed above, the definition of the complexity of inte- 
gers can be extended to the definition of complexity of partial recursive functions 
of any fixed number of variables m, as in VI. 9.1 of [Mai]. This requires a choice of 
Kolmogorov optimal recursive function of m + 1 variables. We have then the fol- 
lowing simple result (omitting the subscripts at C specifying the choices of optimal 
families, and denoting by c with subscripts various constants depending on these 
choices as well): 

2.2.1. Proposition. For any partial recursive function f : Z + — > Z + and 

x G D(f) we have 

C(f(x)) < c f C(x) < c' f x, (2.1) 
If f and x G D(f) are allowed to vary, we have 

C{f{x))<cC{f)C{x)\og{C{f)C{x)). (2.2) 

In particular, if / is a total recursive permutation, then complexities of x and 
f(x) are bounded equivalent. It follows that we can define the complexity function, 
up to bounded equivalence, C : X — > Z + for any infinite constructive world X: 
choose an admissible numbering v : Z + — > X and put C(x) := C u (u~ 1 (x)) for 
some optimal u. 

2.3. Runtimes according to [CalStl]. Proposition 2.2.1 is a special case of 
Proposition 9.6 in [Mai], VI. 9. In turn, it implies as special cases the inequality 
(2) and Theorem 4 of [CalStl]. 

In order to see this, one has simply to compare terminology and notation. 

[CalStl] deals with the complexity C (their V = Vu) of binary words, that 
reduces to the complexity of integers via the admissible numbering denoted bin in 
[CalStl]. It is defined via a "universal Turing machine" U, which in our language 
is a programming method computing one of the Kolmogorov optimal functions u. 
Consider the partial recursive function x \— > t(U)(x): runtime of U at the argument 
x G Z + . The inequality (2) of [CalStl] in our notation can be rewritten as 



C(t(U)(x)) < cx 



(2.3) 
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which is our (2.1) for / = t(U). The same inequality is valid for m(U), s(U), but 
also for t(-F), m(F), s(F) for any F, and even for Soare's settling functions: see 
section 2.1 above. 

2.4.1. Growth of recursive functions and algorithmic randomness. The 

central argument of [CalStl] is based upon two statements: 

a) The runtime of the Kolmogorov optimal program at a point x of its definition 
domain is either < cx 2 , or is not "algorithmically random" (Theorem 5 of [CalStl]). 

b) "Algorithmically random" integers have density zero for a class of computable 
probability distributions. 

This last statement justifies the time cut-off prescription which is the main result 
of [CalStl]: 

if the computation on the input x did not halt after cx 2 Turing steps, stop it, 
decide that the function is not determined at x, and proceed to x + 1. 

Proposition 2.5.1 below somewhat generalizes the statement a). 

2.5. Randomness and growth. Consider a pair of functions (p, ib : R >0 — > 

R>o satisfying the following conditions: 

a) (fix) and X are strictly increasing starting with a certain xq and tend to 

ip(x) 

infinity as x — > oo. 

ib ( x ) 

b) ib(x) and . , . are increasing and tend to infinity as x — > oo. 

x<p(ib(x)) 

The simplest examples are (p(x) = log (a; + 2), ib{x) = (x + l) 1+£ , e > 0. 

In our context, ip will play the role of a "randomness scale". Call x G Z + 
algorithmically ^-random, if C(x) > x/ip(x). The second function ib will then play 
the role of associated growth scale. 

2.5.1. Proposition. Let f be a partial recursive function. Then for all suffi- 
ciently large x exactly one of the following alternatives holds: 

(i) x G D(f), and f(x) < ip(x). 

(ii) xiD(f). 

(Hi) x G D(f), and f(x) is not algorithmically ^-random. 

Proof. We must only check that if x G D(f) and f(x) > ip(x), then f(x) is not 
algorithmically t/7-random, that is 

C[J[X)) £ M)Y (2 ' 4) 
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In fact, in view of (2.1), 



C(f(x)) < cx 



(2.5) 



for some constant c (depending on u and /). Furthermore, for sufficiently large x, 
in view of 2.5 b), we have 



Clearly, (2.5) and (2.6) imply (2.4). 

2.6. Cost estimate functions. Since, as we argued, the randomness/growth 
alternative holds for arbitrary recursive functions, not only for runtimes and alike, 
we will briefly discuss specific properties of runtimes, considered from the perspec- 
tive of categorification, explained in sec. 1. 

Let P be an enriched programming method, as in Definition 1.5.1. We will say 
that a partial function 5 : P(X, Y) x X — > Z + is a cost estimate function, if the 
following conditions are satisfied: 

(i) 5 is partial recursive (morphism in C), and D(5) = {(p, x) \ x e D(f p )}. 

(ii) 8{p o q,x) = S(q,x) + S(p, q(x)) whenever both sides are defined. 

The requirement (i) is natural, because the "run-cost" of computation (time, 
maximum storage size) must be computable in terms of cost increments required 
at each step. The requirement (ii) then expresses the additivity of such increments. 
We may, or may not, ascribe a non-zero cost to the program calculating identical 
function ( "data transfer" ) . 

Requirement (i), complemented by the requirement of the decidability of the 
graph of 5, constitute two axioms due to M. Blum. This latter property has a clear 
intuitive meaning as well. 

Finally, if our cost estimate function refers to time only, and we allow the un- 
restricted parallelism, the following property is natural. Using notation (1.8), we 
must have 

(Hi) S(7r a (p 1 , ...,p n ), (xi, . . . , x n )) = max (8(p 1 ,x 1 ), . . . , 8(p n , x n )). 

2.7. Constants related to Kolmogorov complexity estimates. Since 
inequalities (2.1), (2.2), and their extensions are often useful, we will say a few 
words about their computability. 



cx < 



*l){x) f[x) 



(2.6) 



(f(ip(x)) f{f(x))' 
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As in [Ma3], VI. 9, we call partial maps (Z + ) m — > Z + , m > 0, m-functions. A 
Kolmogorov optimal family of m-functions u(xi, . . . , x m ; k), k G Z + , is produced 
from two inputs: 

(a) A fully effective (in the sense of Rogers, cf. 1.4.4) family of (m + l)-functions 

U. 

(b) A recursive embedding 9 : Z + x Z + — > Z + with decidable image, satisfying 
a linear growth condition 

e{k,j)<k-<p{j) (2.7) 

where : Z + — > Z + an appropriate function. 
Having made these choices, we put 

u(x u ...,x m \k) := U(x u ...,x m \6~ 1 (k)). (2.8) 

Then for any other family v of m-functions v with base Z + and each m-function 
/, we have the inequality 

C u (f) < c u , v C v (f), (2-9) 

with 

c u ,v :=<p{Cu{v)). (2.10) 

(cf. [Mai], VI.9.4). 

Clearly, (2.1) is a special case of (2.9). An effective estimate of (2.10) from above 
will be assured, if <p is computable and increasing, and if, knowing a P-description 
of v, we can find some member of the family U coinciding with v. The latter, in 
turn, is automatic, if P is supplied with a translation morphism trans p^u- 

We will now discuss numberings 9. 

2.8. Slowly growing numberings. Let R = (Rf- \ k G Z + ) be a sequence of 
positive numbers tending to infinity with k. For M G Z + , put 

V R (M) := {(k, I) G (Z+) 2 | kRi < M}. (2.11) 

Clearly, 

<oo, (2.12) 
where [a] denotes the integral part of a. 



cardVR(M) < 



7 1 



M 
Ri 
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We have 

V R (M) C V r (M + 1), (Z+) 2 = u£ =1 Vr(M). 

Therefore we can define a bijection Nr : Z + — > (Z + ) 2 in the following way: 
Nji(k, I) will be the number of (/c, /) in the total ordering <r of (Z + ) 2 determined 
inductively by the following rule: <r (k, I) iff one of the following alternatives 
holds: 

(a) iRj < kRi; 

(b) iRj = kRi and j < I; 

2.9. Proposition. The numbering Nr is well defined and has the following 
property: all elements of Vr(M + 1) \ Vr(M) have strictly larger numbers than 
those o/Vr(M). Moreover: 

(i) If each Ri is rational, or computable from above, then Nr is computable (total 
recursive). 

(ii) If the series YH^i^i 1 converges and its sum is bounded by a constant c, 
then 

N R (k,l)<c(kRt + l). (2.13) 
(in) If the series ^2'iZ 1 R^ 1 diverges, and 

M 

Y^RT^FiM) (2.14) 
1=1 

for a certain increasing function F = Fr, then 

N R (k,l) < (kRi + l)F(kRi + l). (2.155) 



Proof. The first statements are an easy exercise. For (2.13) and (2.14), notice 
that if M is the minimal value for which (fc, /) e Vr(M ), we have M — 1 < kRi < M 
and 

N R (k,l) <cardy i? (M), 
and in the case (ii) we have from (2.12) 

oo 

card V R (M) < MR ™ < c ( kR i + !)• 

m=l 
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Similarly, in the case (iii) we have 

M 

cardV^(M) < M ^ < (kRi + l)F(kR t + 1) 

m=l 

2.10. L. Levin's norms. From (2.13) one sees that any sequence {Ri} with 
converging ^ z R^ 1 can be used in order to construct the bijection Z + x Z + — > Z + , 
(k, I) i— > Nft(k, I) linearly growing wrt k. Assume that it is computable and therefore 
can play the role of 9 in (2.7) (b). 

In this case, for any integer M the set Vr(M) must be decidable. It follows that 
for any /, the set of rational numbers k/M < r\ := R^ 1 is decidable. 

Even if we weaken the last condition, requiring only recursivity of the set k/M < 
ri (i. e. asking each ri to be computable from below), the convergence of Yli r i 
implies that there is a universal upper bound (up to a constant) for such r\ . Namely, 
let CP be the prefix Kolmogorov complexity on Z + defined with the help of a certain 
optimal prefix enumeration. 

2.10.1. Proposition. ([Le]). For any sequence of computable from below 
numbers r\ with convergent J2i r i> there exists a constant c such that for all I, 
r/<c-CP(0 _1 

More generally, L. Levin constructs in this way a hierarchy of complexity mea- 
sures associated with a class of abstract norms, functionals on sequences computable 
from below. 

3. Regular izat ion and renormalization of the Halting Problem 

3.1. Introduction. In this section, we devise simple regular ization/renormali- 
zation schemes tailored to fit the halting problem. The general structure of such a 
scheme is sketched in [Ma3], subsection 0.2. It involves the following components. 

(a) Deforming the Halting Problem. At this step, we transform the problem of 
recognizing, whether a number k G Z + belongs to the definition domain D(f) of a 
partial recursive function /, to the problem, whether an analytic function /; z) 
of a complex parameter z has a singularity (in our case, a pole) at z = 1. 

In fact, using an idea from quantum computing, we may reduce the case of arbi- 
trary / to the case of a partial recursive permutation a = 07 : D(a) — > D(a) of its 
definition domain, and construct 3>(k,cr;z) for such permutations. This reduction 
is described in [Ma3], subsections 3.6 - 3.8. 
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(b) Choosing a minimal subtraction algebra. Our choice of an appropriate mini- 
mal subtraction algebra (see the definition in [Ma3], 4.2) is based on the established 
properties of functions $>(k,a;z): cf. Proposition 3.5 below. 

Namely, let A+ be the algebra of analytic functions in \z\ < 1, continuous at 
\z\ = 1. It is a unital algebra; we endow it with augmentation ej, : $>(z) h- > $(1). 

Put A- := (1 - ^) _1 C[(1 - z)- 1 ]. Finally, let A := A+ © 

Now we can use Theorem 4.4.1 of [Ma3] in renormalization schemes, involving a 
connected filtered Hopf algebra H (cf. [E-FMan], sec. 2.5, Theorem 1, and [Ma3], 
4.1). It remains to indicate, which Hopf algebras and their ^4-characters will be 
involved in this game. 

(c) Hopf algebra of an enriched programming method. A class of such algebras 
is described in [Ma3], subsections 3.3 - 3.4. This construction explicitly refers to 
flowcharts, however, it can be readily modified and generalized to enriched pro- 
gramming methods P in the sense of Definition 1.5.1. 

Basically, H = Hp is the symmetric algebra, spanned by isomorphism classes 
\p] of certain descriptions belonging to, say, -P(Z + , Z + ). Comultiplication in Hp is 
dual to the composition of descriptions: 

A(\p]):= £ M®M- 

q,r\qor=p 

(Recall that the composition of descriptions is associative). 

In order to ensure finiteness of the right hand side of (3.1) and to produce a 
Hopf filtration, we must postulate in addition existence of a "size function" on 
descriptions. The simplest properties of such a function p i— > \p\ that will serve our 
goal, are finiteness of the set of descriptions of bounded size, and additivity 

\q o r| = \q\ + |r|. 

For a concrete example, see [Ma3], subsection 3.4. 

(d) Characters, corresponding to the halting problem. Finally, assume that we 
have constructed Hp and $(/c,/;^) as above. Then the character tp^ : Hp — > A 
(cf. [Ma3], 4.4) corresponding to the halting problem at a point k G Z + for the 
partial recursive function computable with the help of a description p e -P(Z + , Z + ), 
is defined as follows: 

Vkilp]) '■= ®(k,f;z) e A. (3.2) 
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As soon as this definition is adopted, the machinery and philosophy of Hopf renor- 
malization and Birkhoff decomposition ([Ma3], Theorem 4.4.1) becomes applicable 
to the classical halting problem. 

Perhaps, it will be even more relevant for quantum computation schemes based 
upon infinite-dimensional Hilbert spaces. 

3.2. The simplest construction. Let / : Z+ — > Z+ be a partial recursive 
function. Consider its extension / : N — > N defined as follows: f(x) = f(x) if 
x E D(f) and f(x) = otherwise. 

Put 



z n 



*(*,/;*):=£-___. (3.3) 



n=0 

3.2.1. Proposition, (i) If k £ D(f), then 

*(k,f;z) = -±- (3.4) 
i — z 

(ii) If k G D(f), then ^(x, cr;z) is the Taylor series of a function analytic at 
\z\ < 1 and continuous at the boundary \z\ = 1. The value f(k) = f(k) can be 
uniquely reconstructed from ^, for example 

- 1. (3.5) 



z=0 



The proof is obvious. 

Actually, formula (3.3) can be seen in its natural context if one invokes the 
general prescription of reducing any function to a permutation, borrowed from the 
theory of quantum computation. 

I will briefly recall this prescription now following [Ma3], subsections 3.6-3.8. 

3.3. Reduction of the general halting problem to the recognition of 
fixed points of permutations. Start with a partial recursive function / : X — > X 
where X is an infinite constructive world. Extend X by one point, i. e. form 
X II {*x}- Choose a total recursive structure of an additive group without torsion 
on with zero *x- Extend / to the everywhere defined (but generally 

uncomputable) function g : X Y[{*x} ~ >^U{*x}, by 

g(y) :=* x if y t D{f). 
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Define the map 

Tf- (^I[{*X}) 2 -(X]J{* X }) 2 

by 

Tf(x,y) := (x + g(y),y). (3.6) 

Clearly, it is a permutation. Since has n o torsion, the only finite 

orbits of rj 1 are fixed points. 

Moreover, the restriction of 77 upon the recursive enumerable subset 

DM := (X]J{* x })xD(f) 

of the constructive world Y := (X ]j{*x}) 2 induces a partial recursive permutation 
a/ of this subset. 

Since g(y) never takes the zero value *x on y G D(f), but always is zero outside 
it, the complement to D(af) in Y consists entirely of fixed points of 77. 

Thus, the halting problem for / reduces to the fixed point recognition for 77. 

3.4. Permutations with bounded shift. The formula (3.3) can be general- 
ized as follows. 

3.4.1. Definition. Let a be a permutation of Z + , k G Z + . We say that a has 
a bounded shift at k if there exist constants a, 6, c ( depending on a and k ) such that 
for all n G Z, 

c- \n + a\ < a n (k) < c- \n + b\. (3.7) 



3.4.2. Lemma. If a has bounded shift at k, then the a 7, -orbit of k is infinite, 
and for any m^O and any point of this orbit I, a m has bounded shift at I. 

Proof. Let / = a d (k). From (3.3) we get 

c • \mn + d + a\ < a mn (l) = a mn+d {k) < c ■ \mn + d + b\ 



that is 



cm 



n + 



d + a 



m 



< (O n (0 < c\m\ 



n + 



d + b 



m 



(3.8) 



This inequality has the same form as (3.7), with different constants. 
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3.5. Proposition. Let a be a permutation of Z + , k e Z+. Put 

00 n 
n=l 

TTien we /lave; 

^ If a 7, -orbit of k is finite, then <&(a,x;z) is a rational function in z whose all 
poles are of the first order and lie at roots of unity. 

(ii) If this orbit is infinite, and a has bounded shift at (any point of) this orbit, 
then <E>(cr, k; z) is the Taylor series of a function analytic at \z\ < 1 and continuous 
at the boundary \z\ = 1. 

Proof. If <r z -orbit of k is finite, then (3.5) is a finite sum of several geometric 
progressions each of each sums to a rational function of the type 

const • j. 

1 — z l 

Otherwise, because of (3.7) we get a series absolutely converging for \z\ < 1. This 
proves our statement. 

3.6. The Kolmogorov order. Many interesting cr, such as total recursive 
permutations, are not permutations of bounded shift. To cope with this situation, 
we will (uncomputably) reorder Z + , and show, that after this reordering, all partial 
recursive functions and permutations corresponding to them will satisfy a version 
of bounded shift property, allowing one to construct a modification of ^f(z). 

Slightly more generally, let X be an infinite constructive world. Consider an 
optimal enumeration u : Z+ — > X in the sense of Kolmogorov or Schnorr (see 
1.4.4 above). This means that u is total recursive, surjective, and the function 
C u : X - Z+, 

C u (x) := min {k \ u{k) = x} 

is (a representative of) Kolmogorov complexity of constructive objects of type X. 
Now, define the Kolmogorov total order on X associated to u by 

x < y & C u (x) < C u (y) 

and denote by K = K u : X — > Z + the function 

K(x) := 1 + card {y | C u (y) < C u (x)}. 
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Clearly, K is a bijection. If we arrange X in the order of growing Kolmogorov 
complexity, K(x) is precisely the number of x in this order. 

It is convenient also to introduce a Kolmogorov order on Z + . We will denote the 
respective numbering by the same letter K. This should not lead to a confusion. 

It is straightforward to check that for some constant c > and all x G X, we 
have 

c C u (x) <K(x) <C u (x). (3.10) 

Let now a : X — > X be a partial recursive map, such that a maps D{&) to D(a) 
and induces a permutation of this set. Put 

o"k := K o a o K _1 

and consider this as a permutation of the subset 

D(a K ) :=K( J D(a))cZ+ 

consisting of numbers of elements of D(a) in the Kolmogorov order. We have then 
the following modified version of (3.7): 

3.6.1. Proposition. Let x G D(a). If the orbit a z (x) is infinite, then there 
exist such constants ci, ci > that for k := K(x) and all n e Z we /lave 

ci -K(n) < <r%(k) < c 2 -K(n). (3.11) 

Proof. Let k = K(x), x G X. We have for n > 0: 

<7^(fc) = K(a n (x)) < c-K(n) (3.12) 

for any fixed Kolmogorov complexity order on Z + (which we denote by the same 
letter K in order to simplify notation). In fact, if we replace K in (3.12) by the 
appropriate complexity C, this will follow from (2.1), since n h- > a n (x) is an every- 
where defined morphism Z + -> X in C. It remains to invoke (3.10). 

Furthermore, let Y := {a n (x) \ n G Z + }. This is a recursively enumerable subset 
of X, and the partial function A : X — > Z + with definition domain Y - 

A(y) = n, if y = a n (x) 
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is partial recursive. Hence again in view of (3.6) and (2.1), 

K(n) = K(A(y)) < c' ■ K(y) = c' ■ K(a n (x)). (3.13) 

Combining (3.12) and (3.13), we get (3.11) for n > 0. Applying the same reasoning 
to cr _1 in place of a, we obtain (3.11) for negative n. 

3.7. Proposition. With the same notations as in Proposition 3.6.1, put 

i 00 K(n) 

•(*.*;*) = F + g (3 ' 14) 

T/ien we /law: 

(%) If a 7 * -orbit of x is finite, then <&(x,a;z) is a rational function in z whose all 
poles are of the first order and lie at roots of unity. 

(ii) If this orbit is infinite, then &(x,o~;z) is the Taylor series of a function 
analytic at \z\ < 1 and continuous at the boundary \z\ = 1. 

3.8. Remarks, (a) In the proofs of Propositions 3.6.1 and 3.5, we actually 
used only the fact that a restricted to the particular orbit Y := {a n (x) \ n G Z + } 
is recursive, thus justifying our choice of A- in 3.1 (b) above. 

(b) Although Kolmogorov's order is as uncomputable as Kolmogorov's complex- 
ity, there are serious arguments for studying constructions, explicitly involving it, 
such as our renormalization characters. 

One can argue that all cognitive activity of our civilization, based upon symbolic 
(in particular, mathematical) representations of reality, deals actually with the 
initial Kolmogorov segments of potentially infinite linguistic constructions, always 
replacing vast volumes of data by their compressed descriptions. This is especially 
visible in the outputs of the modern genome projects. 

In this sense, such linguistic cognitive activity can be metaphorically compared 
to a gigantic precomputation process, shellsorting infinite worlds of expressions in 
their Kolmogorov order. 
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